2.3 Completeness, Ancillarity

1 Completeness

1.1 Definition

We have introduced minimal sufficient statistics. They may have an additional property called completeness.

Complete Statistic

A statistic T(X) is complete for a family of distributions P={Pθ|θΘ} if no nontrivial function of T can have expectation 0 for every distribution. I.e. Eθ[f(T(X))]=0,θΘf(T)=a.s.0.

A complete statistic does not need to be sufficient. Like T(X)0 is complete in any model.

Complete Sufficient Statistic

T(X) is complete sufficient if both sufficient and complete.

1.2 Full-rank Exponential Families

It's hard to use definition to judge completeness, if T(X) can take on infinitely many values. However, for exponential family, we can easily verify completeness.

Full Rank, Curved

Assume P is s parameter exponential family in minimal form. If Ξ contains an open set, we say P is full-rank; otherwise we say it is curved.

Theorem

If P is full-rank, T(X) is complete sufficient.

If c>0, we define random variables Y+,Y with probability densities f+(x)c,f(x)c. (Here we perform a normalization) Then the MGF of Y+ is MY+(η)=E[eηTY+]=eηTxf+(x)cdμ(x), and Y likewise. So (*) implies that MGFs of Y+,Y are identical in neighborhood of 0. By uniqueness of MGF, we conclude Y+=dY, so f+=a.s.ff=a.s.0.

Now consider the diagram.
Pasted image 20241206202340.png|600
We've stated that A,B are minimal. C is minimal only when s=1.
Now A is full-rank exponential family because it contains an open set. B is curved because it doesn't contain an open set. C is full-rank only when s=1 (or we reparameterize it to make it 1 dimensional).

1.3 Complete Sufficiency is Minimal

Theorem

If T(X) is complete sufficient for P, then T(X) is minimal sufficient for P.

2 Ancillarity

We've discussed sufficient statistics as statistics carrying all information about θ. Now we want to discuss statistics carrying no information about θ.

Ancillary Statistic

V(X) is ancillary for P={Pθ|θΘ} if its distribution does not depend on θ.

2.1 Basu's Theorem

Basu's Theorem is a useful tool to determine the independence of statistics.

Theorem (Basu)

If T(X) is complete sufficient and V(X) is ancillary for P, then V(X)T(X),θΘ.